L1-Norm Robust Regularized Extreme Learning Machine with Asymmetric C-Loss for Regression
نویسندگان
چکیده
Extreme learning machines (ELMs) have recently attracted significant attention due to their fast training speeds and good prediction effect. However, ELMs ignore the inherent distribution of original samples, they are prone overfitting, which fails at achieving generalization performance. In this paper, based on expectile penalty correntropy, an asymmetric C-loss function (called AC-loss) is proposed, non-convex, bounded, relatively insensitive noise. Further, a novel extreme machine called L1 norm robust regularized with (L1-ACELM) presented handle overfitting problem. The proposed algorithm benefits from replaces square loss AC-loss function. L1-ACELM can generate more compact network fewer hidden nodes reduce impact To evaluate effectiveness noisy datasets, different levels noise added in numerical experiments. results for types artificial benchmark datasets demonstrate that achieves better performance compared other state-of-the-art algorithms, especially when exists datasets.
منابع مشابه
Regularized extreme learning machine for regression with missing data
This paper proposes a method which is the advanced modification of the original Extreme Learning Machine with a new tool to solve the missing data problem. It uses a cascade of L1 penalty (LARS) and L2 penalty (Tikhonov regularization) on ELM to regularize the matrix computations and hence make the MSE computation more reliable, and on the other hand, it estimates the expected pairwise distance...
متن کاملA Robust and Regularized Extreme Learning Machine
In a moment when the study of outlier robustness within Extreme Learning Machine is still in its infancy, we propose a method that combines maximization of the hidden layer’s information transmission, through Batch Intrinsic Plasticity (BIP), with robust estimation of the output weights. This method named R-ELM/BIP generates a reliable solution in the presence of corrupted data with a good gene...
متن کاملRegularized Committee of Extreme Learning Machine for Regression Problems
Extreme learning machine (ELM) is an efficient learning algorithm for single-hidden layer feedforward networks (SLFN). This paper proposes the combination of ELM networks using a regularized committee. Simulations on many real-world regression data sets have demonstrated that this algorithm generally outperforms the original ELM algorithm.
متن کاملRobust nuclear norm regularized regression for face recognition with occlusion
Recently, regression analysis based classification methods are popular for robust face recognition. These methods use a pixel-based error model, which assumes that errors of pixels are independent. This assumption does not hold in the case of contiguous occlusion, where the errors are spatially correlated. Furthermore, these methods ignore the whole structure of the error image. Nuclear norm as...
متن کاملRobust Dictionary Learning with Capped l1-Norm
Expressing data vectors as sparse linear combinations of basis elements (dictionary) is widely used in machine learning, signal processing, and statistics. It has been found that dictionaries learned from data are more effective than off-the-shelf ones. Dictionary learning has become an important tool for computer vision. Traditional dictionary learning methods use quadratic loss function which...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Axioms
سال: 2023
ISSN: ['2075-1680']
DOI: https://doi.org/10.3390/axioms12020204